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INPUT NEW MPEG-2 FILE AND 
CREATE REDUCED-QUALITY 
MPEG FILE AS AVAILABLE 
RESOURCES PERMIT 
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NO 




YES 



BROWSE THROUGH 
REDUCED-QUALITY 
MPEG FILE TO SELECT 
IN-POINTS AND 
OUT-POINTS OF CLIPS 
TO BE SPLICED 
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STREAM COMPRESSED 
VIDEO FROM REDUCED 
QUALITY MPEG FILE 
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STREAM ORIGINAL QUALITY l-FRAMES 
AND 3 FREEZE FRAMES PER l-FRAME 




STREAM ORIGINAL 
QUALITY MPEG-2 
CODED VIDEO 



SELECT 1 OR 2 FREEZE FRAMES PER 
l-FRAME FOR DESIRED SPEED-UP 
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STREAM REDUCED-QUALITY l-FRAMES 
AND INSERTED FREEZE FRAMES 



ANCHOR THE FIRST DTS OF THE SECOND CLIP 
AT ONE FRAME INTERVAL LATER THAN THE 
LAST DTS OF THE FIRST CLIP TO PREVENT 
VIDEO DECODING DISCONTINUITY 



. DOES 
142^ ^ THE PCR 

EXTRAPOLATED TO 
THE BEGINNING FRAME OF THE 
SECOND CLIP FALL JUST 
AFTER THE ENDING 
TIME OF THE FIRST 
CLIP 
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ADJUST THE CONTENT OF THE 
FIRST CLIP SO THAT THE PCR 
EXTRAPOLATED TO THE 
BEGINNING FRAME OF THE 
SECOND CLIP FALLS JUST 
AFTER THE ENDING TIME OF 
THE FIRST CLIP 
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DETERMINE THE LAST DTS/PTS OF THE FIRST CLIP 
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DETERMINE THE TIME OF ARRIVAL ( Te ) 
OF THE LAST BYTE OF THE FIRST CLIP 
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ADD ONE FRAME INTERVAL TO DTS U 
TO FIND THE DESIRED FIRST DTS 
LOCATION FOR THE SECOND CLIP 
(DTSfi =DTS L 1 +1/FR ) 
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KEEPING THE DTS-PCRe RELATION UNALTERED 

FOR THE SECOND CLIP, FIND THE TIME INSTANT 

Ts AT WHICH THE FIRST BYTE OF THE SECOND 

CLIP SHOULD ARRIVE 

( T START =DTS F2 -PCR e2 ) 

(Ts =DTSfi -T start ) 
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COMPENSATE FOR THE GAP 
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BIT RATE 

THE NUMBER OF BYTES TO DROP IS 
(Te-Ts )(BIT RATE) 
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IF POSSIBLE, REMOVE NULL PACKETS TO 
DROP THE BYTES, OTHERWISE, REPLACE 
ONE OR MORE FRAMES AT THE END OF 
THE FIRST CLIP WITH CORRESPONDING 
REDUCED-QUALITY FRAMES. 
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THE STREAMS 
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COMPUTE THE VIDEO TIME 
STAMP OFFSET V offset 
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APU POINTER 



ADVANCE APU POINTER TO THE FIRST 
APU BEGINNING IN THE DURATION OF 
THE VPU OF THE l-FRAME IN THE 
ORIGINAL MPEG-2 STREAM 
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INPUT MPEG-2 TS FROM 
WHICH A TRICK MODE 
CLIP WILL BE EXTRACTED 
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AUDIO ELEMENTARY STREAM 
(AES ) EXTRACTED 
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VIDEO ELEMENTARY STREAM 
( VES ) EXTRACTED 
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I FRAME EXTRACTION AND 
VALID PES FORMATION 
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SNR SCALING OF THE 
l-FRAMES-ONLY PES 
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FREEZE P FRAME INSERTION 
AND VALID PES FORMATION 
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TS STREAM GENERATION BY 
MULTIPLEXING THE ABOVE 
VIDEO PES INTO A SYSTEM 
INFO (SI) AND AUDIO PES 
CARRYING TS SKELETON 



SELECTION AND CONCATENATION 
OF THE APPROPRIATE AUDIO ACCESS 
UNITS (FROM THE ORIGINAL ASSET) 
BASED ON THE STRUCTURE OF THE 
VES IN THE TRICK MODE CLIP AND 
VALID PES ENCAPSULATION AROUND 
THESE AUDIO ACCESS UNITS 
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FOR SPATIAL FREQUENCIES 
IN EXCESS OF THE NYQUIST 
FREQUENCY FOR THE 
DOWNSAMPLED VIDEO 
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RETAIN UP TO A CERTAIN NUMBER OF 
LOWEST-ORDER AC DCT COEFFICIENTS 
FOR EACH BLOCK AND REMOVE ANY 
ADDITIONAL AC DCT COEFFICIENTS 
FOR EACH BLOCK 
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RETAIN UP TO A CERTAIN NUMBER OF 
LARGEST MAGNITUDE AC DCT 
COEFFICIENTS FOR EACH BLOCK 
AND REMOVE ANY ADDITIONAL AC 
DCT COEFFICIENTS FOR EACH BLOCK 
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RETAIN UP TO A CERTAIN NUMBER 
OF AC DCT COEFFICIENTS THAT 
DIFFER IN MAGNITUDE FROM UP 
TO THAT NUMBER OF LARGEST 
MAGNITUDE AC DCT COEFFICIENTS 
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PARSE THE NEXT (RUN, LEVEL) EVENT VLC. 



246 




■245 



YES 


COPY 






VLC 





LET R= RUN LENGTH OF ZEROES FOR 
THE CURRENT (RUN, LEVEL) EVENT 



247 



251 



LET 

L=L+R+1 



COPY 
VLC 




YES 



248 



COPY EOB 
MARKER 
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PARSE UNTIL THE END OF THE NEXT EOB 
MARKER IN THE INPUT BIT STREAM 
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PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC 
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PARSE AND DECODE ALL ( RUN, LEVEL ) 
EVENT VLC S UNTIL AND INCLUDING 
THE FIRST EOB MARKER 
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TRANSFORM THE QUANTIZATION INDICES 
TO QUANTIZED COEFFICIENT VALUES 
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SORT THE COEFFICIENTS IN DESCENDING 
ORDER OF THEIR MAGNITUDES 
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KEEP THE FIRST K COEFFICIENTS OF THE 
SORTED LIST AND SET THE LAST 63-K 
COEFFICIENTS OF THE SORTED LIST TO ZERO 
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APPLY ( RUN, LEVEL ) EVENT FORMATION AND ENTROPY 
ENCODING TO THE NEW SET OF COEFFICIENTS 
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COPY THE RESULTING VLC s TO THE OUTPUT 
UNTIL AND INCLUDING THE EOB MARKER 
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( SORT K FROM N ^) 
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GET NEXT COEFFICIENT 
FROM INPUT STREAM 



283 




EOB 



YES 



284 



NO 



( RETURN ) 
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SORT THE 
LIST OF K 
COEFFICIENTS 
BY MAGNITUDE 




YES 



■285 



PUT COEFFICIENT 
INDEX AND MAGNITUDE 
INTO SORT LIST 



i+1 —286 



Fig. 17 
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COEFFICIENT 
MAGNITUDE > MAGNITUDE 
AT END OF LIST 
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YES 
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NO 


GET NEXT COEFFICIENT 
FROM INPUT STREAM 
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( RETURN ) 
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REMOVE ENTRY AT THE 
END OF THE LIST 



■292 



BINARY SEARCH FOR RANK 
POSITION OF CURRENT 
COEFFICIENT 
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INSERT CURRENT 
COEFFICIENT INDEX AND 
MAGNITUDE INTO THE LIST 
AT THE RANK POSITION 



INPUT DESIRED END FRAME OF FIRST CLIP AND 
DESIRED START FRAME OF SECOND CLIP 
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FIND CLOSEST 1 FRAME PRECEDING DESIRED START 
FRAME TO BE THE IN-POINT FOR SPLICING 
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ADJUST CONTENT OF THE FIRST CLIP NEAR THE END 
FRAME OF THE FIRST CLIP AND ADJUST CONTENT OF 
THE SECOND CLIP NEAR THE IN POINT IN ORDER TO 
REDUCE PRESENTATION DISCONTINUITY AND PREVENT 
DECODER BUFFER OVERFLOW WHEN DECODING 
THE SPLICED MPEG STREAM 



— 123 



RE-FORMATTING INCLUDING RE-STAMPING OF 
PTS, DTS AND PCR'S FOR AUDIO AND VIDEO 



C END ) 
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INPUT STREAM 




STRIP HASH TABLE 
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OF COEFFICIENT 
MAGNITUDE 



■315 



INSERT COEFFICIENT 
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HASH TABLE ENTRY 
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INDEX HASH 
TABLE WITH i 
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GET NEXT ENTRY FROM 
HASH LIST AND PUT 
COEFFICIENT IN THE 
OUTPUT STREAM 




YES 



( RETURN ) 




( RETURN ) 
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FIND UP TO k LARGEST MAGNITUDE NON-ZERO 
AC DCT COEFFICIENTS (i.e., THE "QUALIFYING 
COEFFICIENTS") FOR THE BLOCK 
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BEGIN (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER, USING THE SECOND 
CODING TABLE (TABLE 1) 



CONTINUE (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER USING THE SECOND 
CODING TABLE 



333 




336 



IF POSSIBLE, INCLUDE A NON-ZERO, 
NON-QUALIFYING AC DCT COEFFICIENT 
IN THE (RUN LEVEL) CODING TO 
ELIMINATE THE ESCAPE SEQUENCE 
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( RETURN ) 



Fig. 20 



( ATTEMPT ELIMINATION OF ESCAPE SEQUENCE ) Fig. 21 



■341 



IDENTIFY THE FIRST QUALIFYING 
COEFFICIENT AND THE SECOND 
QUALIFYING COEFFICIENT 
CAUSING THE ESCAPE SEQUENCE 



■342 



LOOK FOR A NON-ZERO, 
NON-QUALIFYING AC DCT 
COEFFICIENT BETWEEN THE 
FIRST AND THE SECOND 
QUALIFYING COEFFICIENTS IN 
THE SCAN ORDER SEQUENCE 




YES 



RETURN 
UNSUCCESSFUL 



(RUN, LEVEL) CODE THE NON-ZERO 
NON-QUALIFYING COEFFICIENT 



345 




YES 
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(RUN, LEVEL) CODE THE SECOND 
QUALIFYING COEFFICIENT, 
USING THE NEW RUN LENGTH 
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YES 




NO 



SEARCH FOR 
ADDITIONAL NON-ZERO 
NON-QUALIFYING 
COEFFICIENTS THAT 
WILL ELIMINATE THE 
ESCAPE SEQUENCE 




SELECT THE 
NON-QUALIFYING 
COEFFICIENT GIVING THE 
SHORTEST OVERALL 
CODE LENGTH AND/OR 
THE LARGEST MAGNITUDE 
FOR THE BEST PSNR 



RETURN 
SUCCESSFUL 



i_ 



c 



MPEG SCALING 
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APPLY MODIFIED FDSNR-LM PROCEDURE, USING 
ADJUSTED QUANTIZER SCALE INDEX IF LESS THAN 
THE MAXIMUM POSSIBLE QUANTIZER SCALE INDEX 




Fig. 23 
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ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED QUANTIZER 
SCALE AND SELECT NEW CODING OR 
CODING THAT GIVES BEST RESULTS 




YES 



377 



YES 



380 




YES 



-378 



k-1 




YES 



-381 



k+1 



383 




ATTEMPT RE-CODING FOR LAST 
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PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC 
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PARSE AND DECODE ALL ( RUN, LEVEL ) 
EVENT VLC S UNTIL AND INCLUDING 
THE FIRST EOB MARKER 
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SORT THE COEFFICIENTS IN DESCENDING 
ORDER OF THE MAGNITUDES OF THEIR 
QUANTIZATION INDICES 
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KEEP THE FIRST K COEFFICIENTS OF THE 
SORTED LIST AND SET THE LAST 63-K 
COEFFICIENTS OF THE SORTED LIST TO ZERO 
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APPLY ( RUN, LEVEL ) EVENT FORMATION AND ENTROPY 
ENCODING TO THE NEW SET OF COEFFICIENTS 
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COPY THE RESULTING VLC S TO THE OUTPUT 
UNTIL AND INCLUDING THE EOB MARKER 
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REDUCTION OF THE NUMBER OF BITS FOR 1 
RUN-LENGTH ENCODING OF TRANSFORM 
I COEFFICIENTS OF A BLOCK-CODED PICTURE j 



_____ t 
PIVOT- 1 TECHNIQUE 

SELECTIVELY RETAIN NON-QUALIFYING 
NON-ZERO AC COEFFICIENTS IN ORDER 
TO AVOID ESCAPE SEQUENCES 
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PIVOT-2 TECHNIQUE 

REDUCE THE MAGNITUDE OF THE LEVEL OF 
THE RETAINED NON-QUALIFYING NON-ZERO 
AC COEFFICIENTS TO A VALUE OF ONE IN 
ORDER TO REDUCE THE NUMBER OF BITS 
FOR (RUN, LEVEL) ENCODING OF THE 
RETAINED NON-QUALIFYING NON-ZERO 
AC COEFFICIENTS 



PIVOT-3 TECHNIQUE 

AVOID ESCAPE SEQUENCES AND/OR REDUCE 
THE NUMBER OF BITS FOR (RUN, LEVEL) 
ENCODING BY SELECTIVELY INSERTING A 
NOISE COEFFICIENT OF LEVEL MAGNITUDE 
EQUAL TO ONE (I.E., A PIVOT POINT WHICH IS 
A COEFFICIENT NOT FOUND IN THE ENCODING 
OF THE ORIGINAL PICTURE) IN THE SCAN 
ORDER JUST BEFORE EACH QUALIFYING 
NON-ZERO AC COEFFICIENT 



FIG. 33 



The effect of pivot techniques on the escape sequence count generated by LMCS 

fbrqsv=4 



7000 



6000 



5000 



4000 



3000 



2000 



1000 




Number of AC coefficients retained in each block 



FIG. 34 



: pivot techniques on the escape sequence count generated by LMCS 

forqsv=24 




-4-HH ^-i l i MM<'Mtt » t' | t ' 'i | tfrtt'rt- 1 t t t t t t-t-f 
5 10 15 20 25 



10 15 20 25 30 

Number of AC coefficients retained in each block 



35 



FIG. 35 



4-%K . 4S2 y 



CjCk 



CoEFPtae/vr 
td • < Scan 

FIG. 36 



13 
W 

in 
in 
in 

C3 
m 

CO 
0 
»* 



(7 
/ 



32 

^ 33 



63- 



AG NIT WE OF LEVEL 

4-0 4-t 

I I 





PARTIAL 




PIVOT 










ESCAPE (one) 



FIG. 37 



INSERTION OF PIVOTS FOR 
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PIVOT TABLE 



PPTV«-PPT(RUN, LEVEL) 
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TRANSFORM 
COEFFICIENTS 



INSERT NOISE 
(PIVOT POINTS) TO 
REDUCE THE NUMBER 
OF BITS IN THE 
(RUN, LEVEL) CODING 



. TRANSMISSION OR j 
■ STORAGE OF ] 
(RUN, LEVEL) CODED j 
| TRANSFORM COEFFICIENTS J 
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